Music synthesis for home videos: An analogy based approach

There have been efforts in the recent years to make home videos look more interesting and pleasing to viewers by mixing it with music. Most of the existing software enables the user to add music of his preference. It assumes that the user has enough knowledge about the aesthetic mixing principles. In our research, we propose a way of adding audio to video by synthesizing appropriate music based on the video content. This is a step toward semi-automatic music mixing without totally excluding the user. We have developed a system that takes in music examples selected by the user and generates new music by applying the aesthetic rules of audio-video mapping. The paper concentrates on pitch generation for music synthesized through contour based pitch matching by using technique of string matching. This system would enable the user to understand what music would be suited to a particular video and would assist him in choosing a matching piece of music.